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1. INTRODUCTION 

Combinatorial optimization problem (COP) is the most important class of optimization problems, 
which is involved in finding the best solution amongst discrete group of all available ones for a specified 
problem instance [1], [2]. During the past years, numerous optimization algorithms have been suggested to 
tackle diverse combinatorial optimization problems efficiently [1]. One of the relatively recent population- 
based metaheuristic (PBM) algorithms is harmony search algorithm (HSA), which managed to solve several 
hard combinatorial optimization problems. HSA, which was proposed by Geem et al. [3] is a modern nature 
inspired that has gained increasing attention from many researchers as a state-of-the-art algorithm designing a 
solution for hard COPs [4]. HSA is inspired by a resemblance to the musical improvisation process taken by 
musicians to improvise their musical tones to find, through repeated iterations, a state of pleasant/harmony 
(optimum solution to a problem), according to the aesthetic norm, just like the optimization process attempts 
to get an optimal solution, which is determined by an objective function. During the music production 
progression, a musician picks and accumulates various amount of pitches from the preceding knowledge, and 
performs notes by musical instruments in order to get an ideal state of harmony in music [4]. HSA has its 
own unique features, which makes it distinct from other metaheuristic algorithms. These features can be 
summarized as shown in: i) HSA is considered as being simple and flexible, thus it stimulates researchers and 
academics to perform several modifications to improve its performance. ii) HSA is considered as a 
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population-based algorithm, but it possesses components of a single-based algorithm. iii) HSA is capable of 
constructing a new solution (new vector) out of a combination of each current solutions (vectors) (namely, 
the harmonies inside the HM). This makes the HSA utilize the harmony memory more efficiently than the 
genetic algorithm (GA), which combines only two parents of solution vectors to form the new solutions [5]. 
This feature makes HSA free from the building block theory that highly affects the mechanism of GA. iv) 
HSA is able to consider all component variables in a vector independently; whereas the GA is incapable of 
doing it, as it has to keep the gene’s structure [6]. v) HSA includes a lot of characteristics of existing 
metaheuristic algorithms [7]. It is capable of preserving a record of former vectors (through HM) in a way 
resembling the tabu search (TS) algorithm [8]. Likewise, it is capable of varying the parameters of the 
optimization dynamically, like simulated annealing [9]. Finally, HSA can manage numerous solution vectors 
concurrently in a way analogous to the genetic algorithm [10]. vi) HSA needs less computational effort, in 
terms of memory and runtime (unlike GA), as it does not require crossover and mutation operators [5]. vii) 
More importantly, HSA provides a possibility to attain a balance between exploitation and exploration via 
tuning the HSA improvisation operators (memory consideration, pitch adjustment, and random selection) [6]. 

Ever since the advent of the HSA basics in 2001, numerous variants of this algorithm have 
commenced to solve various kinds of optimization problems. These variants range from hybridizing some 
components of other metaheuristic methods to the framework of HSA, to taking some concepts of HSA and 
hybridizing them in the framework of other metaheuristic methods. HSA has been effectively utilized to 
solve lots of optimization problems. Lots of researches have been conducted in different areas such as 
timetabling, scheduling, artificial neural network, image processing, vehicles routing, medical imaging, job 
shop scheduling, and many others. Good references for the applications and developments of HSA are 
available in [5], [6], [11]. The enhancement of the fundamental HSA has interested lots of scholars to 
develop and improve the performance of the HSA to produce good quality results that meet the requirements 
of the problems to be solved. Like other metaheuristic algorithms, basic HSA requires proper parameter 
setting so as to improve the search performance. Slow convergence problems can arise owing to an improper 
setting of the parameters. Depending on the problem at hand, these settings need to be carefully assigned. 
Hence, the empirical experiments trials seem to be the only way to select the best parameter values. In this 
paper, scholars review the fundamental HSA and the most important hybridizations and modifications found 
in the literature of HSA. 


2. CANONICAL HARMONY SEARCH ALGORITHM 

Like a group of musicians, when they develop their harmonies practice by practice, HSA enhances 
solutions iteration by iteration using a good candidate of solutions that been discovered during the 
construction of solutions and improvises (generates) a new solution (harmony) iteratively for a given 
problem. In each iteration, HSA improvises a new solution using the three rules known as i) memory 
consideration, ii) pitch adjustment, and iii) random consideration [12]. The resemblance between the 
improvisation of music and optimization problems is illustrated in Table 1. 


Table 1. The similarity between optimization and improvisation [13] 


Musical terms Optimization terms 
Aesthetic standard Objective function 
Harmony Solution vector 
Improvisation Generation 
Musician Decision variable 
Pitch Value 
Pitch range Value range 
Pleasing harmony Optimal solution 
Practice Iteration 


As illustrated in Table 1, there is some equivalence between the musical terms and optimization. 
The improvisation in music matches generation of solution (i.e., harmony), every musician or instrument 
matches every decision variable, every tone (pitch) of music instrument matches the value of the decision 
variable; the pitch range resembles the range of each variable; the esthetic standard of a harmony matches the 
value of the objective function of a solution; the repetitively improving of pleasant musical harmony matches 
improving a solution vector; a new harmony which is generated thru using each of the music instruments 
matches the optimization problem’s solution. 
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2.1. Fundamental structure of HSA 

As pointed out by Moon et al. [14], Zhang and Geem [15], and Doush et al. [16], the basic 
procedure of HSA comprises six steps that are applied in order to attain improving process. Step 1: initialize 
parameters of HSA; step 2: initialize HM; step 3: improvise new harmony; step 4: update HM; step 5: check 
stopping criteria; and step 6: cadenza. The flowchart shown in Figure 1 explains the basic HSA steps. 


STEP 1 STEP2 
Initialize parameters of HSA Initialize (build) Harmony Memory (HM) 


for i =1 to HMS do 
p| Randomly generate one harmony (s) 


HMS: Harmony Memory Size 
HMCR: Harmony memory Consideration Rate 


PAR: Pitch Adjustment Rate Calculate f(s) 
Add (s) to the HM 


end for 


NI: Number of Improvisations 


STEP 3 


Improvise new solution 


* Pitch Adjustment Rate 
* Harmony Memory Consideration Rate 
* Random Consideration 


STEP 6 
Cadenza Yes Termination No New solution better 
(return thebest |4— condition reached << than the worst in 
solution) (NI)? 


| | Yes 
$ STEP 4 
| Update HM | 


Figure 1. Flowchart of the basic HSA’s components 


2.1.1. Step 1: Initialize HSA parameters 
In this step, the parameters’ values of the HSA are initialized. HSA has four parameters [6]: 

- Harmony memory size (HMS) defines the total solutions (harmonies) which are kept in the (HM). 

- Harmony memory consideration rate (HMCR) is exploited in the improvisation (generation of solution) 
process. Based on HMCR, the decision variable of a new solution will be chosen from the HM (with 
HMCR probability) or should be chosen randomly from the available search space (with 1- HMCR 
probability). HMCR typically takes a range value set between (0, 1). 

- Pitch adjustment rate (PAR) is exploited as well in the improvisation process. If a number generated at 
random is smaller than the value of PAR, the value of the decision variable that has been chosen from 
the harmony memory should be modified to its neighboring value, otherwise, it has not changed. The 
PAR value is set between (0, 1). 

- Number of improvisation (NI) denotes the maximum value of iterations, which HSA will be repeated, 
and it is considered as a stopping condition. 


2.1.2. Step 2: initialize (build) the harmony memory (HM) 

Harmony memory is represented by a 2-D array. It consists of randomly generated solutions, 
wherein every row denotes a solution vector. The number of generated solutions is equal to HMS and sorted 
based on the objective function (maximizing or minimizing), as shown in (1). 
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where x1, X2,..., XN-1, Xy represent a candidate solutions, N represents the number of candidate solutions in 
each solution vector, and f(x!), f(x?),..., fx™™S) represent the corresponding penalty, objective function, of 
each solution vector. 


2.1.3. Step 3: Improvise a new harmony (solution) 

During this stage, a new harmony (solution) vector, x’ = (x’1,x’2,x’3,...,x’N), is generated 
(improvised) via the improvisation process according to the three rules known as: i) memory consideration, 
ii) pitch adjustment, and iii) random consideration [6]. As shown in (2) shows the selection mechanism of 
HSA. 


Xicey E (x2), xi(ki)}  Ww.p Prandom 
xie” SAK) E {xf xP, ep w.p Pmemory (2) 


xi(k +m) w.p Pitch 


As shown in (2), the value of variable i (i = 1,2,...,j) would be arbitrarily chosen out of a group 
of all candidate values {xi(1), xi(2), ...,xi(ki)} with a probability of Prandom (random consideration); or it 
would be chosen out of a group of values kept in the HM with a probability of Pmemory (memory 
consideration); or with a little change by moving to neighbor values xi(k + m), with a probability of Ppitcn 
(pitch adjustment) [13]. 


2.1.4. Step 4: Updating harmony memory (HM) 

The improvised harmonies (new solutions) are evaluated according to the objective function f(x) 
value. If the new harmony is better in terms of quality, the HM is updated by substituting the worse harmony 
with the improvised one x’ = (x'1,x’2,x’3,..,x’N). Then, the HM is sorted so that to allocate the new 
harmony in the right position. Otherwise, the newly generated solution is ignored. 


2.1.5. Step 5: Check stopping criteria 

This step examines the HSA termination condition. If the stopping condition happens (reaches the 
maximum number of improvisations (NI)), the algorithm will stop, or else the updating and improvisation 
processes in steps three and four are repeated. Generaly, the maximum number of improvisations is treated as 
the stoping criterion in HSA. 


2.1.6. Step 6: Cadenza 

A cadenza is a bravura musical performance, which takes place at the last stage of a movement of a 
composition in order to yield the best pleasant harmony ever performed in the improvisation process. In the 
sense of the HSA, a cadenza may be denoted as the final stage that happens in the last part of searching 
procedure for the finest harmony. During this step, the HSA returns the highest-quality solution ever stored 
and found in the HM according to the fitness function f(x). 


3. STATE-OF-THE-ART HARMONY SEARCH ALGORITHM 

Over the last years, HSA has drawn increasing attention as scholars have endeavored to utilize it to 
solve various optimization problems. Accordingly, lots of scholars have made an effort to develop and 
improve the performance of the HSA to get good quality results that meet the requirements of the problems 
to be solved. In order to improve the search efficiency of basic HSA, it requires appropriate parameter 
setting; for example, a slow convergence issue might happen because of improper parameter setting. Those 
settings need to be carefully assigned depending on the problem at hand. Therefore, several scholars have 
attempted to tackle the slow convergence problem of HSA via conducting several enhancing modifications. 
Modifications comprised i) Carefully tuning the HSA parameters, and ii) Hybridizing HSA with various 
metaheuristics [7]. The following subsections highlight the most important modifications that have been 
made to the HSA over the last two decades. 
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3.1. Modifications to harmony memory (HM) Initialization 

After initializing the parameters of the HSA, the second step is the initialization of the HM, where a 
set of harmonies (solutions) is created randomly to fill up the HM. The harmony memory size (HMS), which 
denotes the number of harmonies in the HM, is set in the initialization step. According to the literature of 
HSA, a few studies have attempted to improve the initialization of the HM. 

In order to improve the frequency and get global optima, Geem [8] presents two modifications for 
varying (diversification) the solutions kept in HM. The first one generates a number of initial solutions that in 
total are larger than the HM size, and the second restricts the number of similar solutions kept in HM. 
Hadwan et al. [9] utilized a semi-cyclic shift pattern method to initialize the HM, in place of using the 
random mechanism in classical HSA. Pichpibul and Kawtummachai [10] incorporated the probabilistic 
savings heuristic into HSA to enhance the HM initialization. In order to achieve selection that is more 
efficient during the improvisation process, they employ the roulette wheel selection mechanism. Al-Betar 
et al. [17] suggested the island-based HSA (iHS) that has been adopted in evolutionary algorithms (EAs). In 
iHS, the HM is divided into several subpopulations (islands) and every island evolves individually for a 
number of repetitions. 


3.2. Modifications to improvisation step 

During the last few years, many scholars have attracted modifications of the improvisation process 
of the HSA. The selection of the most suitable parameter setting values is too difficult duty for the HSA, and 
for many other metaheuristic algorithms as well. The setting of these parameter values is problem-dependent. 
Hence, empirical experiments are the only way for choosing the best parameter values [18]. 

Many variants of the HSA have been proposed based on several additional mechanisms, concepts, or 
components to make the HSA parameters adapt dynamically during the search process. In this context, Wang 
et al. [19] propose an algorithm called the adaptive binary harmony search (ABHS) algorithm to tackle 
binary-coded optimization problems. In ABHS there are some modifications such as a new rule for PAR that 
is used to improve the search capability. Also, they applied two new HCMR techniques (the bit selection 
strategy and the individual selection strategy). In addition, they investigated two updating methods (parallel 
and serial updating), and they developed a scalable adaptive strategy to enhance its optimization capability 
and robustness regarding the parameter study. Lin and Li [20] proposed a hybrid binary HSA (HBHSA) to 
tackle winner determination problem. Both PAR and HMCR are changed to attain the balance between 
diversification and intensification. Keshtegar et al. [21] introduced another variant of HSA called adaptive 
dynamic harmony search (ADHS) algorithm. In this algorithm, a new solution was improvised according to 
the information kept in HM. The new HM is generated dynamically in two phases. In the first phase, the HM 
is adjusted based on the minimum and maximum number of the decision variables with a dynamic HMCR as 
shown in (3). 


HMCR (i) = 0.95 + 0.1 x |+ = Oj (3) 


Where, i denotes the number of the current iteration, and NJ denotes the max value of iterations. Based on 
(4), the harmony memory is computed as: 


es T + ./1—k/NI x BW;(k), with probability HMCR 3 4) 
: xt +r x (xf — x}),with probability 1 — HMCR (k) 
where, BW(k) is a dynamical bandwidth, that proposed as in (5), 
max_ „min k 
d a Ne © 


where x;™" and x;™** are the minimum and maximum values for design variable x; in HM. In the second step, 
the new HM was modified by the coefficient and the PAR as described in (6). 


PAR(k) = 0.3+06x(1- 1- 5 (6) 


NI 


Mansor et al. [22] studied the problem of premature or slow convergence by dynamically changing 
parameters in HSA. In this work, HMCR is given a small value in the first step of generation. To improve the 
convergence, Gaussian distribution function is utilized to produce numbers randomly as an alternative to 
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uniform distribution function. Moreover, the PAR and BW values were changed dynamically. Kalivarapu 
et al. [23] suggested a self-adaptive improved HSA (SIHSA) on the basis of dynamic change in BW. The 
adjustment in BW is calculated as in (7): 


BW (gn) = ——a (7) 
1+k(Z) 
BWmax 
S80 210 (se mes) (8) 


where z and m are constants, and their values count on the minimum and maximum values of BW, and m 
should be more than 1. 

Another variant of HSA for solving continuous optimization problems was suggested by 
Abedinpourshotorban et al. [24]. Two improvement techniques were added to the standard HSA in this 
variant. The first was applied in the initialization of the harmony memory. Instead of a random generation of 
the initial harmony memory, the solutions in the harmony memory were initialized vertically in such a way 
that prevents the algorithm from stacking in the local minimum. The second improvement technique replaced 
the PAR in the basic HSA with the mutation strategy taken from the differential evolution algorithm. The 
suggested algorithm is compared with other variants of HSA. The result indicated that the proposed 
algorithm outperformed the algorithms in terms of convergence rate and robustness. 

Wang et al. [25] proposed a new HSA variation on the basis of dual strategies and adaptive 
parameters (DSAHS). In DSAHS, the initial value of the HMCR is fixed to 0.95 and the PAR is set to 0.5. 
During the search, HMCR and PAR are tuned automatically on the basis of the feedback of the fitness of new 
harmony, if the current HM is updated, the values are kept unchanged, otherwise, HMCR randomly picks a 
value in a range of (0:9; 1:0) and PAR randomly selects a value in a range of (0:1; 1:0). Guo et al. [26] 
proposed an adaptive HS with best-based strategy (ABHS). ABHS adopts a similar parameter control 
strategy with DSAHS [25]. In ABHS, the initial value of the parameter HMCR is generated at random in a 
range of (0:9; 1:0) and the parameter PAR is generated at random in a range of (0:3; 1:0). During each 
iteration, HMCR and PAR are re-initialized with a low probability of 0:1. 

Shaqfa and Orban [27] changed the PAR step of parameter-setting-free HSA (PSFHSA) proposed 
by Geem and Sim [28] to improve the problem of the parameter-setting of HSA, and used it on the concrete 
beam design optimization. To enhance the capability of PSFHSA, Jeong et al. [29] improved an enhanced 
form of PSFHSA (APSFHSA) by reducing the extra memory needed throughout the search progression. 


3.3. Modifications to stopping criteria 

In the HSA, the improvisation process of a new harmony and the updating of the HM are terminated 
once the stopping condition is met. Many stopping criteria have been used for the HSA such as: reaching 
maximum computational time, reaching the maximum number of improvisations, reaching predefined value 
of the objective function, reaching maximum or minimum results, or reaching a predefined number of non- 
improvements in the objective function during the improvisation process. A little research can be found in the 
literature pertaining to proposing a new stopping criterion of the HSA. Kattan et al. [30] used the improved 
harmony search (IHS) (which is suggested by Mahdavi et al. [31]), for feed-forward artificial neural 
networks (ANN) as a new method for training techniques. The authors modified the stopping criterion of the 
IHS according to best-to-worst (BtW) harmony ratio in the current HM instead of using the standard stopping 
criterion where HSA halts once the maximum number of improvisations (NI) is reached. Fourie et al. [32] 
proposed another stopping criterion, where they measured the distance between the best and worst solution in 
the HM. Moreover, they also used a trade-off between speed and accuracy to stop the current process and 
move to the next phase. Table 2 summarizes the most important works related to the HSA parameters setting. 


3.4. Hybridizing the HSA with other metaheuristic components 

The process of hybridizing some components of variants of metaheuristic algorithms to enhance the 
performance of these algorithms has been reported in the literature and is highly suggested by many scholars 
[5], [18]. HSA is characterized as being simple and flexible, so it motivates scholars to combine it with some 
other metaheuristic components. Moh'd Alia and Mandava [7] categorized the studies related to hybridization 
of HSA with other metaheuristics into two groups. The first group focuses on the hybridization of 
metaheuristic components with HSA to enhance its performance. Whilst the second group focuses on the 
combination of the components of HSA with other metaheuristics. HSA has been hybridized with other 
metaheuristic algorithms such as ant colony optimization (ACO) [33], genetic algorithm (GA) [34], particle 
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swarm optimization (PSO) [35], simulated annealing (SA) [36], memetic algorithm (MA) [37] and many 
others [6]. Table 3 summarizes the studies related to the hybridization of HSA with other metaheuristics. 


Table 2. Variants of HSA on the basis of improvements of parameters setting 


Algorithm Parameter(s) 


Description 


References 


HSA- stopping 
variant condition 
EHSA  HMCR, PAR, 
HM 
initialization 
ABHS PAR 
HSA- HM 
variant initialization 
iHS HM 
SIHSA BW 
HSA-  HMCR, PAR, 
variant BW 
HSA- PAR, HM 
variant initialization 
ADHS HM 
DSAHS HMCR, PAR 
ABHS HMCR, PAR 


MPSFHSA PAR 


HBHSA PAR, HMCR 


APSFHSA HMCR, PAR, 


The termination condition is substituted with best-to-worst (BtW) harmony ratio Kattan et al. [30] 


in the present HM 


The values of HMCR and PAR are dynamically changed. A semi-cyclic shift Hadwan et al. [9] 


pattern approach is utilized to initiate the HM 


A new pitch adjustment strategy is adopted to improve the BHS performance via Wang et al. [19] 


selecting the adjacent value from its neighborhood 


Incorporate the probabilistic savings heuristic into HSA to enhance the HM (Pichpibul and 


initialization 
It learns the concepts of island model that has been adopted in EA. 
A self-adaptive Improved HSA (SIHSA) on basis of dynamic change in BW. 


Kawtummachai [10] 
Al-Betar et al. [17] 
Kalivarapu et al. [23] 


HMCR is given a small value in the first step of generation. the PAR and BW Mansor et al. [22] 


values were changed dynamically. 


Instead of a random generation of the initial HM, the solutions in the HM were Abedinpourshotorban et 
initialized vertically. The PAR was replaced with the mutation strategy taken al. [24] 


from the differential evolution algorithm. 


The new HM is generated dynamically in two phases. In the first phase, the HM Keshtegar et al. [21] 


is adjusted based on the minimum and maximum number of the decision 
variables with a dynamic HMCR. In the second stage, the new HM was modified 
by the coefficient and the PAR 


During the search, PAR and HMCR are tuned automatically on the basis of the Wang et al. [25] 


feedback of the fitness of new harmony. 


The initial value of the HMCR is generated randomly in a range of (0:9; 1:0) and Guo et al. [26] 


the parameter PAR is generated randomly in a range of (0:3; 1:0). During each 
iteration, HMCR and PAR are re-initialized with a low probability of 0:1. 
The step of pitch adjustment is modified in PSFHSA 


Shaqfa and Orban [27] 


Both PAR and HMCR are changed to get the balance between diversification and Lin and Li [20] 


intensification 


An enhanced form of PSFHSA (APSFHSA) by reducing the extra memory Jeong et al. [29] 


BW requirement throughout the improvisation process 
Table 3. Hybridizing HSA with components from other metaheuristic algorithms 
Algorithm Description References 
HSA+BA The Bee algorithm generates the HM for HSA. Nguyen et al. [38] 
ACO+HSA (AntHSA) The HSA is hybridized with two concepts borrowed from ACO (pheromone and Amini and Ghaderi 
heuristic values). [39] 
HSA+ RW The roulette wheel selection mechanism is adopted to achieve more efficient Pichpibul and 
selection during the improvisation process. Kawtummachai [10] 
HSA+BBO rok mutation operator in the BBO is utilized in the improvisation phase of the Wang et al. [40] 
HSA+SS+ SU+ MB The HM is initialized based on reference set mechanism. HSA convergence is 
improved via including Symmetrical Uncertainty and Markov Blanket filter within Shreem et al. [41] 
HSA. 
HSA+PSO PSO is used to enhance the solution quality of the initial harmony memory (HM). Zhao et al. [42] 
HSA+Global-best PSO This hybrid algorithm changes the randomization mechanism of HSA with Global- Cheng et al. [43] 
best PSO search and neighborhood search. 8 i 
HSA+BBO To exploit the migration operation of BBO to enhance the new harmony Zheng et al. [44] 
improvisation process of HSA. 
HSA+GDL The searching ability of GDL is utilized to optimize the weight of FLANN in 3 
; re a Naik et al. [45] 
order to improve the classification accuracy. 
HSA+CS The mutation operator is used to enhance the harmony in HSA via enhancing the 
Wang et al. [46] 
convergence speed. 
HSA+ACO The ideas of ACO are combined into HSA to improve the convergence rate. Fouad et al. [33] 
HSA+FA HSA is utilized to mutate the firefly algorithm to escape the solutions, that stuck 
; . Rehman et al. [47] 
into local optimum. 
HSA+VNS A hybrid HSA with variable neighborhood search (VNS) is suggested to tackle Zhao et al. [48] 
permutation flow shop scheduling problems (PFSSP). EEA 
HSA+HC+SA+RTR+RTS AHSA inserts an adaptive selection mechanism to automatically choose a proper 
i h Yassen et al. [49] 
SBM for vehicle routing problem. 
HSA+Jaya HSA has been adapted to tackle the 0/1 Knapsack problem by combining objective 
function to treat the weight criterion and excluding the bandwidth of HSA to get Alomoush et al. [50] 
better results. 
HSA+SA HSA has been modified to accept even inferior solutions with likelihood defined 


by a parameter known as Temperature (T). 


Assad and Deep [51] 
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On the other hand, metaheuristic algorithms have been given an HSA component to enhance the 
performance of those algorithms through the integration of the HSA concepts into the structures of these 
metaheuristics. For instance, Li and Li [52] proposed a Novel hybrid particle swarm optimization (NHPSO) 
aiming to solving high-dimensional optimization problems in an efficient way. The authors merge the HSA 
into PSO to avoid the variables from flying outside their variables’ boundaries (prevent the pbest concept 
from violating the variables boundary). In another example, the GA performance was developed using the 
HSA improvisation concept. In this work, the mechanism of selecting the decision variables of the HSA 
throughout the improvisation process is employed to improve the selection mechanism of the GA [53]. Table 
4 summarizes some examples of the hybridization of HSA components with other metaheuristic algorithms. 


Table 4: Hybridizing components and concepts of HSA into other metaheuristic algorithms 


Algorithm Description References 
GA+HS The HSA idea of searching is utilized to enhance the ability of Genetic Algorithm. Qinghua et al. [54] 
PSO+HS The idea of HM in HSA is combined into PSO to avoid the pbest concept of PSO from violating Li et al. [52] 

the boundary of the variables. 
GA+HS The mechanism of choosing the decision variables from all vectors kept in the HM is imitated to Li et al. [53] 
enhance the selection mechanism of GA. 
LDA+HSA HSA is utilized as a preprocessing method to tackle the Linear Discriminate Analysis (LDA) Moeinzadeh et al. 
problem. [55] 
PSOPC+ The concept of HM is utilized to adjust the variable constraints in Particle Swarm Optimizer with Kaveh and 
ACO+ HS Passive Congregation (PSOPC). Talatahari [56] 
GA+HS HSA is employed to attain the balance between exploitation and exploration in the GA. Nadi et al. [57] 
BA+HSA The PAR is used as a mutation operator throughout the process of the bat algorithm to enhance Wang and Guo 
the convergence speed. [58] 
CRO+HSA The HSA improvisation rules are adopted in the reproduction process of the Coral Reefs Salcedo-Sanz et al. 
Optimization algorithm (CRO). [59] 
PSO+HSA A method for improving network lifetime is suggested via exploiting PSO algorithm-based Anand and Pandey 
clustering and HSA-based routing in WSNs. [60] 
CS+HSA A hybrid Cuckoo Search (CS) with HSA-based energy equivalent node clustering protocol is Gupta and Jha [61] 


suggested, that uses a new fitness value for the uniform pattern of cluster leaders. 


4. CONCLUSION 

Harmony search algorithm (HSA) has confirmed its capability in tackling hard combinatorial 
optimization problems such as scheduling problems, course timetabling, vehicles routing, and many others. 
HSA still attracts the attention of scholars because of its generality, flexibility, and has a well-balanced 
mechanism to improve both global and local exploration abilities. However, despite the good performance of 
HSA, researchers still need to overcome some shortcomings, such as slow convergence due to the HSA’s 
fully random mechanism for generating the initial harmony memory. Different issues and aspects related to 
HSA have been discussed concerning new variants proposed to overcome the weakness of basic HSA. Many 
variants of HSA have been proposed by hybridizing some concepts of other metaheuristic approaches to 
enhance HSA or employing some components of HSA to improve other metaheuristic methods. This study 
also had reviewed research pertaining to parameter settings in HSA and its applications to efficiently solve 
hard combinatorial optimization problems. 
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